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ABSTRACT 

The purpose of this investigation was to identify 
item factors that may contribute to differential item functioning 
(DIF) for black examinees on Scholastic Aptitude Test (SAT) analogy 
items. Initially, items were classified according to several possible 
explanatory factors. Preliminary analyses identified several factors 
that seemed to affect DIF for blacks. Secondly, these factors were 
further investigated by classifying and analyzing analogy items from 
two additional SAT forms. Results indicate that black students need 
more time to complete the SAT verbal sections than do their white 
counterparts with comparable overall SAT verbal scores. Once DIF 
statistics were corrected for speededness, a smaller number of 
analogy items were identified as differentially more difficult. Some 
of the factors appear to be interdependent; these factors include 
item position within each analogy set, difficulty, subject content, 
and level of abstractness . The effects of homographs and semantic 
relationship types are also confounded with the previous factors. 
Generalizations to be drawn from these results are limited since 
analyses are based on regular administration items, which tend to 
have severcl factors operating in a single item and which contain 
infrequent occurrence of some factors. (TJH) 
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Abstract 

The purpose of the present investigation was to identify ite factors than 
may contribute to differential item functioning (DIF) for Black examinees on 
Scholastic Aptitude Test (SAT) analogy items. This research was considered 
necessary because analogy items have repeatedly been identified as 
differentially more difficult for Black examinees. The research was performed 
in two steps. Initially items in three forms were classified according to 
several possible explanatory factors. Preliminary analyses identified several 
factors that seemed to affect DIF for Black examinees. In order to confirm 
these hypothesized factors, a second step involved classifying and analyzing 
analogy items from two additional SAT forms. 

The most significant finding is that Black students appear to need more 
time to complete the SAT verbal sections than White students with comparable 
total SAT verbal scores. This differential speededness effect makes analogy 
items appear differentially more difficult for Black examinees. Cnce 
differential item functioning statistics were corrected for speededness, a 
smaller number of analogy items were identified as differentially more 
difficult. In addition, evaluation of the hypothesized factors showed that some 
of the factors are interdependent and no clear distinction ccuJd be made to 
determine out their individual effects. These item factors are: item position 
within each analogy set, difficulty, subject matter content, and level of 
abstractness. The effects of homographs and semantic relationship types are 
also confounded with the previous factors. The orly factor that seemed to be 
-independent was ^vert al relationships". In general, a vertical or word 
associative answering strategy seems to be more consistently used by Black 
examinees on those itejis with negative DIF. 

Generalizations to be drawn from these results are limited because the 
analyses are based on regular administration items which tend to have several 
factors operating in a single item and which contain infrequent occurrence of 
some factors. At this stage, these results provide a clearer picture of how 
comparable Black and White students respond on analogy items and the factors 
that might influence their performance. 
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Previous research findings have shown that Scholastic Aptitude Test (SAT; 
analogy items are unexpectedly more difficult for Black examinees chan for incite 
examinees with the same level of verbal ability (Dorans, 1982; Kulick, 1984). 
These results have been replicaced across tests and across methodologies for 
detecting differential item functioning (DIF) but are not readily explained 
(Echternacht. 1972; Scheuneman, 1978; Strieker, 1982; Rogers & Kulick, 1986). 

The purpose of the present investigation was to identify item factors tuat 
may contribute to DIF for Black examinees on SAT analogy items. The research 
was perfoLTned in two steps. Initially, the SAT form used in Kulick' s (1984) 
study was examined to generate hypotheses for the DIF found in analogy items. 
No apparent explanations were observed. Two additional forms were then studied 
and items were classified according to several possible explanatory factors. 
Preliminary analyses identified factors which seemed to be related to DIF for 
Black examinees. In order to confirm these hypothesized factors, a second step 
involved classifying and analyzing analogy items from tvo additional SAT forms. 

Any source of confusion that may deter examinees from finding analogical 
relationships could affect performance on analogy items. Preliminary DIF 
analyses for Black examinees (cn three SAT forms) identify the following as 
possible determinants of DIF on analogy items. 

o differential speededness 

o position within verbal section 

o subject matter content 

o word abstractness 

o relationship between stem and key 

o non-analogical strategies, i.e., vertical relationships or v;ord 
associations 

o sources of vocabulary confusion, i.e., homographs 
o semantic relationship tjrpes 

The present study evaluated each of these factors. 

ERIC 7 
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Method 

D ata Source 

The data for this investigation come from the SAT-Verbal item responses of 
White and Black examinees to five SAT forms. Identification of the SAT forms, 
administration dates and samples by subgroups are presented in Table 1. 

Insert Table 1 about here 

The verba] test contains 25 Antonym items, 15 Sentence Completion items, 25 
Readi.ng Comprehension items, and 20 Analogy items. Items from each type are 
located in each of the two verbal sections (VI and V2) which make up the 85- item 
SAT-Verbal test. Ten analogies are located at the end of VI, the 45- item verbal 
section, while the other ten are positioned in the middle of V2, the 40-item 
verbal section. 

Performance on the total SAT-Verbal section is reported on the standard 
College Board scale of 200 to 800. All total verbal sections of the SAT forms 
used had typical reliabilities (.90's) and met the statistical specifications 
for difficulty. 

Procedure 

The standardization method devised by Dorans and Kulick (1986, 1983) was 
uspd to study DIP between Black and White test takers. This method identifies 
unexpected differences in item performance after controlling for ability level 
differences through standardization. Ability is defined as the total scaled 
score level on the SAT-Verbal test. The standardization method has been adapted 
to analyze distractors (including not-reached end omitted responses) and permits 
variations on how to define the calculation of difficulty values. (See Dorans 6c 
Schmitt, 1986.) 
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Since evaluation of SAT Fonn OF by Kulick (1984) provided no explanation 
for DIF in the analogy items, two additional forms (Forms 3H and 4K) were 
analyzed. Results of these analyses were used to postulate factors that iright 
explain DIF for Black examinees. Two more forms'^ (Forms 31 and 5E) were then 
examined to validate tue hypothesized factors. 

Statistics for each item of the 20- item analogy set in each of the five SAT 
forms used were calculated using the standardization methodology. Distractor 
analyses were done for four^ of these five forms. In addition, DIF statistics 
were calculated by defining difficulty values as total correct divided by all 
students taking the test (DSTD^) and total correct divideu by all students who 
reached the item (DSTD2). 

Result:* and Discussion 
For purposes of this study, results are shown for each SAT form. Forms are 
ordered by sample ability level, so that results can be interpreted according to 
the differences of each population (for lower ability examinees harder items 
will be less discriminating). 

Differential Speededness 

Distractor analyses demonstrated that analogy items In VI were 
differentially reached by Black examinees. Since these items are located at the 
end of VI (the longest of the two Verbal sections) which is more speeded than 
V2, analogy items were more affected. The proportion of Black examinees 



^Initial preparation of the data for these forms was done as part of a study by 
R. Freedle. Mr. Freedle provided the matrix of the data on which further 
analyses were performed. 

2 

The data matrix from the form used by Kulick (1984) was not available and 
further analyses could not be performed without incurring additional expense 
not budgeted for this study. 
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reaching these itemz tended to be lower than the proportion of White examinees 
with the same ability. In order to correct for this effect, the standarization 
index was recalculated after the proportion correct at each score level was 
redefined from total correct divided by all students taking the test 
(P - R/R+W+O+NR), referred to here as DSTD^, to total correct divided by only 
those students who reached the item (P - R/R+W+0) , referred to here as DSTD^, 
where R - rights, W - wrongs, 0 - omits, and NR - not reached. 

Median values of each of the two standardization DIF indices (DSTD^ and 
DSTD^) by verbal section and position within section are presented in Table 2. 



Insert Table 2 about here 



Comparison of DSTD values indicate that if only DSTD^ is considered VI has 
a higher negacive overall DIF, indicating that Blacks tend to do differentially 
worse on the VI analogy items, which appear at the end of VI. After correcting 
for speededness using DSTD^, this apparent DIF is more in line with that found 
on the V2 analogy items, which appear in the middle of V2. In addition, DSTD^ 
and DSTD^ are essentially the same for V2 items, indicating that no correction 
is needed, i.e., there is no differential speededness effect for V2 analogy 
items. This is very clear when the two DSTD values are plotted. Figures 1 to 8 
show the two DSTD values for each item by Verbal section. The solid line in 
these figures represents the line of zero difference between same ability Black 
and White examinees, while the dashed lines indicate |dSTD| > .05. A |dsTD|>.05 
has been recommended as an useful cutoff for DIF research while a |dSTD|>.10 
identifies problematic items (Dorans & Kulick, 1986). 



Insert Figures 1-8 about here 



10 



5 

For VI, in all cases, the effect of correcting for differential speededness 
(using DSTD^) is to make the negative standardized differences less negative and 
the positive more positive. In other v/ords, negative differential item 
functioning for Black examinees is not as extreme as that observed prior to the 
correction. 

It is important to note that despite controlling for differential 
speededness, a number of analogy items remain more difficult than expected for 
Black examinees. Table 3 summarizes the number of differentially difficult 
items by Form, item type, DSTD calculation, and DSTD value using DSTD cutoffs of 
< - ,05 and < - .10. 

Insert Table 3 about here 

Even after correcting for differential speededness, analogies remain among 
the two most differentially difficul.t item types for Black examinees (the other 
being antonyms), but this difference is not as extreme as it appeared when 
differential speededness was not taken into consideration. After this 
correction and considering -.10 as the DSTD cutoff, analogy items appear 
considerably less problematic for Black students than earlier research 
indicates. Because of these results, further analyses on the analogy items is 
reported only for DSTD2. 

Position within Verbal Section 

The results shown in Table 2 and Figures 1-8 indicate that if che analogy 
items within the verbal sections are further divide^ into the first five items 
and last five items, the first five items account for most of the negative DIP 
found. 
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It is important to point out here that analogy items within each 10- item 
set are organized by difficulty, from easiest to hardest. A trend had 
previously been observed showing that there is a relationship between item 
difficulty and differential performance by Black examinees. This possible 
interaction between differential performance of a subgroup and item difficulty 
has been reported by Shepard, Camilli, and Williams (1934) and by Rogers and 
Kulick (iy86) in studies of Black differences and by Schmitt (in press) in a 
study of Hispanic differences. 

Specifically, when using the standardization method, part of this apparent 
relationsliip between item difficulty and DIF is a function of the weights used 
in the differential item functioning analyses, which are the relative 
frequencies of the Black sub -population at each scaled score level of the SAT 
verbal test. Since Black examinees are a lower scoring group, p-dif f erences 
between comparable Black and White examinees on easy items will have a greater 
weight than on hard items. Standardization places the focus on the items which 
are most relevant for the group. Also, hard items have little impact on group 
performance, contributing very little to the difference between group means. 
Other factor-^ might also contribute to making eaiser items appear more difficult 
for Black examinees. Some of these factors are discussed subsequently. 

Sub-ject Matter Content 

Test development content specifications were used to analyze the effect of 
subject matter content on DIF. The four subject matter content classifications 
used are: 

o Aesthetics or Philosophy - which includes art, literature, drama, music, 
religion and other related subjects. 
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o World of practical affairs - which includes economics, politics, sports and 

other related subjects, 
o Science - which includes biology, applied science, agriculture, medicine 

and other related subjects, 
o Human relationships - such as emotions, family, character analysis, 

psychology, etc. 

Differential item function statistics for analogy items in each verbal section 
and total test for the four subject matter content classifications are presented 
in Table 4. 



Insert Table 4 about here 



Results in Table 4 show that the science subject matter content classification 
has the highest negative DIF of all classifications and that this negative DIF 
is consistent across forms. Inspection of the positions where science content 
^*tems are located indicates that in all forms a higher proportion are among the 
first five items of each 10- item set (31-4/1, 3H-3/2, 4H-4/2, 5E-4/1) where the 
fraction after each form code represents frequencies by position (numerator - 
first five positions; denominator - last five positions). 

Humcin relationship subject-matter content shows the highest and most 
consistent positive DIF, indicating that Black students tend to do better on 
items whose content is about human relationships. In this classification, as 
with science, there seems to be an interaction with position. More human 
relationsnip items are positioned as the last five items of each set: (31-1/3, 
3H-2/3, 4H-2/2, 5E-0/5.) 

The interrelationship among subject content, position, and difficulty could 
explain why items exhibit differential functioning. For example, more abstract 
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words are used in the hardest items, which generally appear among tha last five 
items of each analogy set. In addition, abstract terms are used to express 
human relationships. On the other hand, science related words tend to be 
concrete and be used on easier items, which are located among the first five 
items of each analogy set. 

Word of Abstractness 

As implied by the previous explanations, the abstractness of the words in 
the items might also have an effect on DIF. Test development classifications 
were used to evaluate word abstractness. The categories used are defined as: 
o Concrete - all words in the stem and key represent concrete entities, 
o Mixed - words in the stem and key are a combination of concrete and abstract 
entities. 

o Abstract - all words in the stem and key represent intangible entities. 
Table 5 presents median values of DIF statistics for analogy items by 
verbal section for the abstract/concrete cl * ?ification. 



Insert Table 5 about here 



Results show that items with concrete words tend to have more extreme negative 
DIF. Inspection of where these items are located indicates that they tend to be 
most consistently positioned as the first five items of each set. (31-6/0, 
3H-5/0, 4H-4/1, 5E-5/0). 

Abstract words are usually used in analogy items which show consistent 
positive DIF by Black examinees. These items tend to be located in the last 
five positions of each 10-item analogy set. (31-1/6, 3H-1/7, 4H-3/3, 5E-0/7), 

hi 
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As with subject matter content, word abstractness has an interdependence 
with position and item difficulty as factors influencing DIF. This 
interdependence prevents a clear discrimination of the effect of each individual 
factor on DIF. 

Relationship between Stem and Key 

A third classification by test development categorizes items accordirg to 
whether or not the stem and key overlap. The two categories are: 

o Independent - neither word in the key is suggestive of a word in stem., 
o Overlapping - one or both of the words in the key is suggestive of one or 
both words in the stem. 
Result^ of DIF for analogy items categorized into "independent" or 
"overlapping" by forms and verbal sections are presented in Table 6. 

Insert Table 6 about here 

Results for the "independent" or "overlapping" categories are not 
consistent and seem to be mostly dependent on item position. For items 
classified as "independent" the proportion of first position to last position 
is: 31-5/8; 3H-7/9; 4H-5/8; 5E-5/7. As seen by the DIF medians on Table 5 for 
the "independent" category there 5s almost no DIF. For the "overlapping" 
category there is slightly more negative DIF but it interacts with position. 
(31-5/2; 3H-3/1; 4H-5/2; 5E-5/3.) 

Vertical Relationships 

Another way to categorize the relationship between the words of the stem, 
key and dis tractors can be defined as a vertical relationship. Vertical -word 
associations are non- analogical answering strategies where the relationship 
between che terras on the analogy item stem are not considered when selecting an 
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optiop as correct. Typically, an analogy item is composed of S:T :: 0:P (where 
S:T is the stem ana 0:P is any of the five options). A vertical relationship 
will be made when an association is found between S and any 0 or T and any P. 
For example: 

PHYSICIAN : PATIENT : : (A) nurse :hospital 
(B) guard:warden informer : agent 

(D) attorney: lawyer accountant : client 

The desired relationship in this item is one of subject to recipient, but the 
non-analogical vertical type of relationship is a medical one, making distractor 
A (nurse rhospital) an attractive distractor. Use of such incorrect 
non- analogical answering strategies which involve vertical association between 
words cculd be used more by examinees who are less experienced with analogies. 

Each word of the key and distractors for each analogy item was classified 
in terms of its one-to-one relationship to the stem. For example, in the 
analogy- item stem "SOCCER:TEAM" the term "team" in the stem would have a 
vertical relationship to "coach" and to "players" in a distractor, m that coach 
and players are part of a team. Thio distractor would receive a code of 2 for 
the two vertical relationships. In this way, for each item, its key and each of 
its distractors could be classified as having from zero to two vertical 
relationships. In addition, for purposes of analysis, a total vertical 
relationship was obtained for the distractors by adding all distractor codes. 
Each word of the 80 analogy items was classified by at least four people: by two 
tost development specialists and by the two primary investigators. Consensus of 
all four people was reached for any discrepancies. Results of DSTD^ medians for 
vertical relatiopships in the key and in all distractors of analogy items by 
form and verbal section is presented in Table 7. 
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Insert Table 7 about here 

Due to the small number of vertical relationships ^n some categories, the 
codes were collapsed to present results of DIF medians. Vertical relationships 
for the key were defined £ occurring or not. If at least one word in the key 
was vertically related to the stem, the key was given a code of one; if no word 
in the key was vertically related to the stem, the key was given a code of zero. 

It was expected that, if vertical relationships were used more by Black 
examinees when the relationship was located in the key, then Black candidates 
should perform differentially better than White examinees on those iteiiis. 
Results for vertical relationships on the key show that the medians for either 
code are not consistent. Examination of item position helps interpret results 
further. The proportion of items in each position for those items where there 
is a vertical relationship in the k y is: 31-6/2, 3H-4/2, 4H-5/2, and 5E-4/2, 
More than twice the ntunber of items where there is a vertical relationship in 
the key are located in the first five positions of each verbal sections. Only 
for Form 3H is the median DSTD2 values somewhat negative (-.02). 

Categories of vertical relationships for distractors were added across all 
distractors and further collapsed for the category represented by a two. This 
category includes two and three vertical relationships. Category three 
represents those items where more than three vertical relationships were 
identified across its distractors. Results indicate that the expected negative 
DIF for more vertical relationships in the distractors is observed. It is 
possible that distractors might become more attractive because of the vertical 
relationships preventing selection of the key or use of the real analogical 
relationship. As the niimber of vertical relationships increase, the DIF medians 
are more negative . 

o 17 
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Homographs 

Words which are spelled alike but have different meanings in English, i.e., 
homographs, have been identified as a factor that might make items unexpectedly 
more difficult for some minority groups such as Asian-Americans (Bleistein & 
Wright, 1986) and Hispanics (Schmitt, in press). An example of a homograph is 
"nail" which could be interpreted as the nail of one's finger or the ,.ail 
designed to be hammered. 

A source of vocabulary confusion such as homographs would especially affect 
analogical relations. If terms in the stem are not understood, analogical 
relationships cannot be established. 

Each pair of words in the analogy item (stem, key and each distractor) was 
classified as either having or not having a homograph. Values for homograph 
(Classifications could be either 0 (no homograph) or 1 (homograph) . Homographs 
were identified by the same four people an.l as with vertical relations, 
disagreements were resolved by consensus. 

Stem-key combinations we.-e also considered for homographs since, when they 
cire located in both, the combination might be a stronger source of confusion. 
Due to the minim il numbers of items (4 items in 31 and 1 item in 5E) that had 
this combination, results are not reported. Differential item function medians 
for homographs ir. the stem or in the key are presented in Table 8. 

Insert Table 8 about here 

Results indicate that where there is a homograph in the stem or in the key. 
Black students tend to do differentially worse (i.e. there is negative DIF) . 
These results are consistent across forms and do not seem to be as 
interdependent on item position within Verbal section as do other factors. 
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All homographs in a particular item were added to produce a total homogrdph 
value. This value included homographs in the stem, key and distractors. In 
order to deal with categories that had no values for most forms, when total 
homograph values were three or more they were collapsed; in such cases the 
homograph level is represented by a 3. Results of median DSTD^ values for each 
of these categories across forms and verbal sections are presented in Table 9. 

Insert Table 9 aboat here 

Results show that as the number of homographs increases there is a tendency 
to have more negative DIF. This result is consist .it across forms and verbal 
sections and again does not seem to be as dependent on position as other factors 
have been. 

Semantic Relationships 

The general nature of the relationship between the words in the stem of an 
analogy item can define the type of association that needs to be made in order 
to correctly identify the option with the same relationship. A number of 
semantic relationship taxonomies that classify these associations have been 
developed (Whitely, 1977; Chaffin & Peirce, 1986; Freedle & Gitomer, 1985). 

For purposes of this study, since the nature of the relationship was seen 
as a possible source of differential item functioning, Chaffin and Peirce 's 
(1986) as well as a newer version of Freedle and Gitomer' s (1985) semantic 
relationship taxonomies were used to classify 60 analogy items. Forms OF, 3H, 
and 4H were classified by Freedle using his taxonomy and by Chaffin and Peirce 
using theirs. One principal investigator of this study also classified all 
items of these three forms using both taxonomies. Since the twc. rtaxonomies 
differ more on level of detail than on actual classifications, Chaffin and 
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Peirce's taxonomy was used for further analyses on DIF. This classification was 
chosen because it tends to be more inclusive and can be collapsed into five 
basic relationship types. In addition, two test development specialists and one 
of the principal investigators classified the previous three forms as well as 
forms 31 and 5E using Chaffin and Peirce's classification. The discrepancies 
found were resolved by consensus. 

Chaffin and Peirce's taxonomy consists of ten families of relations that 
were described by Chaffin and Peirce (1986) as follows: 

1. CLASS INCLUSION: one word names a class that includes the 
entity named by the other word. Example: flower: tulip. 

2. PART-WHOLE: one word names a part of the entity named by the 
other word or something that can never be part of the entity 
named by the other word. Example: tree: forest. 

3. SIMILAR: _ one word represents a different degree or form of 
the object, ;>.ction, or quality represented by the other word. 
Example: breeze: gale. 

4. ATTRIBUTE: one word names a characteristic quality, 
property, or action of the entity namad by the ether word. 
Exiimple: glass : fragile . 

5. CONTRAST: one word names an opposite or incompatible of the 
entity named by the other word. Example: default :payment. 

6. NON -ATTRIBUTE: one word names a quality, property, or action 
that is ch^'racteristically not an attribute of the entity 
named by the other word. Example: famine :plentitude . 

7. CASE RELATION: one word names an action which the entity 
named by the other word is usually involved in, or both words 
name entities that are normally involved in the same action 
in different ways, e.g., as agent, object, recipient or 
instrument of the action. Example: doctor :patient. 

8. CAUSE/PURPOSE: one word represents the cause, purpose or 
goal of the entity named by the other word, or the purpose or 
goal of using the entity named by the other word. Example: 
joke: laughter. 

9. SPACE/TIME: one word names a thing or action that is 
associated a particular location or time named by the other 
word. Example: belt: waist. 
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10. REPRESENTATION: one word names something that is an 

expression or representation of, or a plan or design for, or 
provides information about, the entity named by the other 
word. Example: person:portrait . (pp. 3-5) 

For purposes of this study the taxonomy was simplified by collapsing across 

some of these relations. A five category taxonomy was suggested by Chaff in and 

it was kept basically the same after it was corroborated as conceptually clear 

by the test development specialists and principal investigators. The relations 

collapsed were: 1) Class Inclusion and Part-Whole, 2) Similar and Attribute, 3) 

Contrast and Non-Attribute, and 4) Case Relation, Cause-Purpose, and Space -Time. 

The fifth type was considered independent of the other t3rpes and was depicted as 

Representation (the original tenth family relation). Results of the analyses by 

the simplified taxonomy are presented in Table 10. 

Insert Table 10 about here 

For each of the five simplified semantic relationship classifications the 
median of DSTD^ was calculated by form, for VI, V2, and total test. Results 
show that for some of the five categories the frequency of items in each by form 
is low. This is especially true for "Representation." The first (Class 
inclusion & Part-whole), the fourth (Case Relation, Cause -purpose , & 
Space-time), and the fifth (Representation) classifications have the most 
consistent negative DIF, while the remaining other classifications, the second 
(Similar & Attribute) and third (Contrast 6e Non-attribute), have the most 
consistent positive DIF. Further inspection slows that again there is an 
interdependence with position. For the first, fourth, and fifth 
classifications, the items are mainly located in the first five positions of 
each analogy section (First: 31-4/1; 3H-3/0; 4H-2/0; 5E-2/1; Fourth: 31-5/3; 
3H-2/2; 4H-5/5; 5E-6/1, and Fifth: 31-1/0; 3H-2/0; 4H-1/0; 5E-1/0). For the 
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second and third classifications, the items identified in these categories are 
mainly positioned as the last five items of each analogy section (Second: 
31-0/2; 3H-3/4; 4H-2/3; 5E-1/5, and Third: 31-0/4; 3H-0/4; 4H-0/1; 5E-0/2). 
Based on these results, no clear conclusions can be reached because of the 
interdependence between the semantic relationship classifications and position 
or difficulty. 

Distractor Analyses 

In order to explore further the previous studied factors, items from each 
form that had high DSTD2 values have been reproduced in Tables 11 to 14. 



Insert Tables 11-14 about here 



For each form, items were organized first from the most extreme negatively 
discrepant, to the least extreme negatively discrepant and second from the most 
extreme positively discrepant to the least extreme positively discrepant using c. 
(DSTD^I cutoff of .05. This cutoff was used in order to evaluate a larger 
number of items. For each of these items, the item number (which indicates 
position within analogy section, items 36-40 and 16-20 being the first five 
items of each section) and the actual items with the values of DSTD2 for each 
distractor as well as for omitted responses are presented. In addition, the 
actual P value for the Black subgroup, specific characteristics for the test 
development classifications of subject matter, abstractness level, and the 
relati. nship between stem and key, and for the classifications by vertical 
relationship, homographs and semantic relationships have been identified for 
each item. 

Table 11 presents this information for form 31. As observed on Figures 1 
and 2, only three items have absolute values of DSTD higher than .05 and of 
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those, two higher than .09. On item 18, the most extreme positive item (DSTD = 
.20) which is out of bound from the values represented in Figure 2, Black 
students performed much better. This item includes esoteric ^ _abulary which is 
favorable to the Black ethnic background. The word "dashiki" is an African ^ocd 
which represents a type of garment. White students perform differentially worse 
on this item, and this DIF might be related to less familiarity with the term 
"dashiki." If White examinees do not know the meaning of this word in the stem, 
they may not be able to make the analogical connection that is required to 
answer the item. In addition, the percentage of comparable ability White 
students who opt to omit this item (17%) is much higher than the comparable 
percentage of Black students who omit it (5%). Distractor analyses also show 
that White students were differentially drawn more by the most attractive 
distractor (B) (17% of Whites versus 13% of Blacks) which has a vertical 
relationship co the word "garment", the second term of the stem. 

Not many items such as item 18, with esoteric vocabulary for White 
students, are found among SAT analogies, but such an occurrence makes it clear 
that if vocabulary knowledge peculiar to one subgroup is required to solve 
analogy items, analog5cal reasoning skills might not be the main construct 
tested for that subgroup. Furthermore, the differential attractiveness of 
distractors which have vertical relationships indicates that, in such items, 
non-analogical reasoning might come into play. 

Item #37 was the only analogy item in form 31 that was differentially more 
difficult for Black students. Inspection of distractors and item 
characteristics indicate that Black students tended to differentially omit this 
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item more than Whites (11% Blacks versus 7% Whites) and that the preponderance 
of homographs in the stem, key and dis tractors might have made this item 
differentially more difficult for Black students. In addition, Black examinees 
tended to pick the two most attractive distr£?ctors B-13% and C-16%. Based on 
the results, it is interesting to note that on those items that are 
differentially more difficult for Whites, White students will have a higher 
tendency to omit while for those items that are differentially more difficult 
for Blacks, Black students will try to use other strategies and choose a 
distractor, rather than omitting the item. Prior research on omitting patterns 
has shown that another minority group, i.e., Hispanics, in general, also omit 
differentially less than Whites (Rivera & Schmitt, 1986). 

Items 39 and 42 are deemed interesting because even though thay have 
virtually no DIF, the distractor analysis shows that different dis tractors are 
differentially drawing Black and White students. In itom 39, distractor A is 
differentially more attractive to Blacks while distractor D is more so to 
Whites. Interestingly, the word "fuel" in distractor A, which is the most 
attractive distractor in general, has a vertical relationship to the word 
"petroleum" in the stem, while distractor D has a loosely analogical 
relationship to the stem (to get an "alloy", you have to "blend"). It would 
appear that distractors with analogical types of relations might differentially 
draw more White students while distractors with vertical types of relations 
might differentially draw more Black students. Item 42 distractor information 
seems to corroborate this observation. Distractor C with a vertical 
relationship is differentially more attractive to Black examinees while 
distractor E, with a very loose associative type of relationship (lots of 
"trucks" are found on a "highway") is differentially more attractive to VJhite 
examinees. 



19 

Table 12 presents chose analogy items in Form 3H which have DIF > |.05|. 
As seen in Figures 3 and 4 n>ost DIF seems to occur in the first five items of 
each analogy set. There are five items which have negative DSTD^ values that 
are lower than -.05 and two items that have positive DSTD^ values higher than 
.05. Inspection of these items in Table 12 shows that four of the five negative 
items are located in the first five positions of either section arid that three 
out of these four items also have Science subject matter content. 

Item 16 has the most extreme negative DIF on this form. Inspection of the 
distractor DSTD2 values shows that distractor C, the most attractive distractor 
for both groups, differentially draws more Black students. This distractor has 
a vertical relationship to the stem. In addition, this item also has a 
homograph in one of the distractors, was categorized as of science content and 
consists mainly of concrete words. An item similar to this one also appeared as 
item 19 of Form OF with some variations: 

EPIDERMlSrBODY: • (A) stemrplant 
(B) air: diver (ci bark: tree 



(D) fur: coat (E) nail : finger 
The stem of item 16 (Form 3H) is the key of item 19 (Form OF). As it appeared 
in Form OF, this item also was differentially harder for Black examinees 
(DSTD^ - -.0775). Distractors D and E were classified as having a vertical 
relationship on Form OF. 

Items 37 and 21, which are aif ferentially harder for Black examinees, have 
science-related technical terms in the stem. For example, if the term "cumulus" 
in item 37 is not known, its analogical relationship to "cloud" cannot be nade ; 
selection of the correct response would then be more difficult. Tliis same 
observation can be made for the word "gully" in item 21. Item 21 is also 
noteworthy in that it is located in the second section set of V2 , is a hard item 
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for Black examinees (P^ - .33) and has been differentially omitted more by this 
subgroup . 

Item 36 distractor analysis provides quite interesting results. Even 
though this item does not have hard vocabulary, science content or homographs, 
distractor analysis shows that the two distractors which Black students selected 
differentially more start with the prefix "auto", which is also part of the 
first word in the stem. Nevertheless distractor C, which also starts with the 
prefix "auto", was not selected differentially more by Black examinees. 
According to this observation, it would appear that, in some cases, 
non-analogical relations are being used differentially more by Black examinees 
when answering analogy items. 

Item 17 distractor analysis shows that Black examinees chose distractor B 
differentia.uly. Tl\is distractor V7as identified as having a vertical 
relationship to the stem. The key and distractor A were also classified as 
having vertical relationships but also have homographs which might be stronger 
sources of confusion than the homograph for '»play" in distractor B. 

The two items in Form 3H that had DSTD^ values higher than .05, indicating 
that they are differentially easier for Black examinees, were classified as 
having subject matter content of practical affairs (item 20) and of human 
relations (item 39). Interestingly, both items are located in one of the first 
five positions of their respective sections. Apart from neither of these two 
items including any homographs or having distractors with vertical 
relationships, there does not seem to be any other explanation for why ihey are 
differentially easier for Black examinees. 

Corresponding information for Form 4H is presented in Table 13. As 
observed in Figures 5 and 6, three items have IDSTD2I values greater than .05, 
two favoring White and one favoring Black examinees. As observed in Table 13, 
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in both of the negatively discrepant iteins (17 and 40) the stem is vertically 
related to the option which is differentially distracting Black students away 
from the key. On item 17, 15% of Black students are relating option D - 
"coach: players" to SOCCERrTEAMS (compared to 12% of the matched White students; 
rather han perceiving the analogical relationships of "golf : individuals" . 

On item 40, 21% of Black students (compared to 17% of the matched White 
students) are attracted to the vertical relationship between ECHO: SOUND and 
option B "amplifier: speaker" . An additional source of confusion here may be the 
homograph in option B. This item has alro been classified as having science 
content which, as noted earlier, seems to be more difficult for Black examinees. 

Interestingly, the one item (#42) on which Black students perform better 
than expected (despite the vertical relationship between the stem, 
SYCOPHANT: FLATTERY .d .option C - "bandit :hypocrisy") is classified as Human 
Relations. The focal and base groups are also differentially omitting this item 
(Blacks, 29% and matched Whites, 38%). The large proportion of omitted 
responses here may be attributable to the difficulty of the vocabulary. Here 
again White examinees opt to omit differentially. 

Item 37 (the second analogy item in VI) is of particular interest because a 
very similar item is used on Form OF where it appears as item 17 (the second 
analogy item in V2) as: 



The terms of both the stem and the key are exactly the same but the order nas 
been reversed. The DSTD, value for item 17 in Form OF is -.0383. Recall, 
however, that only DSTD^ is available for Form OF. The comparable DSTD^ 
statistic for Form 4H is -.0.28. The item is located in the first position 
(i.e., among the first five items) in 4H-V1. It is in this position that the 




ERIC 



27 



22 

effects of differential speededness on analogy items are most extreme. When 
this is controlled for, the DSTD2 value drops to -.0425 making the items, as 
they appear in the two forms, of comparable differential difficulty for Black 
examinees . 

Items 39, 43, and 23 are presented as of particular interest due to the 
observed differential omit patterns. For item 39, responses are characterized 
by omission fo). 15% of Blacks and 18% of comparable Whites. The corresponding 
figures are 16% and 21% for item 43, and 37% and 43% for Item 23. 

Figures 7 and 8 indicate five items on Form 5E with IDSTD2I values greater 
than .05. Of these, only two are negatively discrepant items. Both of the 
items with negative DSTD^ values are classified as "Science" (see Table 14), 
both have vertical relations, and both are in Semantic Relations category 4. On 
item 17 (the most negatively discrepant), option C, "oar : rowboat" , with its 
vertical relationship to the stem, "CANOE :RAPIDS" is differentially attracting 
Black examinees. On item 19, option A, "distance : space" is attracting Black 
students differentially and, again, there is a vertical relationship with the 
stem, "ACRE:LAND". An additional source of appeal for option A may be the 
homograph " space " . 

Of the three items on which Black students did better than expected, items 
21 and 41 are classified as having Human Relations subject content and in 
addition do not have any homographs or vertical relationshii . . In the third item 
;20) the key "compile : collection- has a vertical relationship with the stem 
"CONVENE:ASSEMBLY" . 

Among the other items of interest listed in Table 14, item 38 was selected 
because of the differential response patterns of Black and White examinees. 
Option B, "steel: tin" is vertically related to the stem "ALUMINUM: METAL" and is 
the most differentially distracting for Black students. On item 39, Whites 
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differentially select option D, "recital: concert" which has a lose analogical 
relationship to the stem "REHEARSAL: PLAY" , while in option C, 

"applause :performance" (the response differentially selected by Black students) 
the term "performance" has a vertical relationship to the term "play" in the 
stem. 

It appears that vertical relationships between the s 'em and distractors 
differentially influence the responses of Black examinees, not only on items 
which have virtually no DIF, but even in those on which Black students do better 
than expected. 

Conclusions 

Several factors that seem to be related to the DIF between matched White 
and Black examinees on 80 SAT analogy items from four test forms have been 
studied. Results indicate, that after differential speededness is taken into 
account, the apparent higher negative DIF (i.e., DIF favoring matched White test 
takers) particular to VI items is attenuated. On average only one item per form 
has a DSTD value that is lower tb^.i - .10. For each of these extreme negative 
items, there is a factor or item characteristic that can explain why these items 
are differentially harder for Black examinees. Vertical relations seem to be 
the most consistent explanatory characteristic. Items with science content that 
are positioned among the first five analogy items of either VI or V2 are also 
frequently identified as differentially harder for Black examinees but, since 
there is an interdependence ith item positiox\ and difficulty, the science 
effect is harder to separate. Homographs were also identified as a source of 
confusion that can make vocabulary items harder foi subgroups with poor 
vocabulary skills. Those results suggest several points about the performance 
of comparable Black and White examinees (matched on total SAT-Verbal score) . 
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These are: 

o Differential Spe ededness . iMack students seem to take longer to 
finish teres than White students with comparable total SAT Verbal 
scores, indicating that speeded tests will be differentially more 
speeded for Black examinees. This differential speededness might be 
related to less well developed test- taking skills. Studies of DIF by 
Ironson and Subkovlak (1979) and by Sennott (1980) showed evidence of 
differential speededness. This finding does not imply, however, that 
if given more time students will have better total scores. Reseaxch in 
which testing time was varied for different ethnic groups has shown 
that the extra time did not differentially help any of the groups 
(Wild, Durso & Rubin, 1982). 

o Position. Item D ifficulty, or Subject Content . Items in the first 
five positions of each analogy section seem to more consistently be 
identified as differentially harder for Black students. These items 
are generally the easier items for both groups. The interdependence 
between subject content ("science" for differentially harder and "human 
relations" for differentially easier items for Black examinees), item 
position or difficulty, and level of abstractness makes it difficult 
differentiate which factor is most relevant. In addition, the higher 
proportion of homographs on concrete terms which tend to be part of 
easier items may make the vocabulary more confusing. 

o Vertical Relati onships . Distractors that have other than ar. analogical 
relationship to the stem, such as a vercical relation -hip , can 
differentially attract more Black examinees, particularly when the stem 
has terms that are difficult or confusing. In cases where vocabulary 
in the stem is more difficult or confusing for Whites and the item is 
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differentially more difficult for Whites, White students tend to omit 
differentially more. Black students, on the other hand, seem to try to 
guess more and use other strategies (such as vertical relationships) 
proportionally more than omitting when the item is differentially more 
difficult for them. When matched White students choose a distractor 
proportionally more than Black students, Cney tend to be drawn more 
toward distractors that have some level of horizontal or an/ilogical 
association between the terms, rather than toward distrac'jors with 
vertical relationships. These different strategies by Black and VThite 
students in answering analogy items might be related to a differential 
familiarity with the item type and/or with analogical reasoning by the 
proportion of the Black population that misses the item, 
gources of Vocabulary Confusion. Use of words that might be more 
esoteric for one subgroup disadvantages their use of analogical 
reasoning. Correct knowledge of the meaning of a word is imperative in 
order to make the analogical connections needed to correctly answer 
analogies, in addition, even for terms that seem relatively easy, 
sources of vocabulary confusion, such as homographs, might interfere 
with the understanding of their meaning. Homographs were observed morc- 
frequently on those items that were identified as differentially harder 
fcr Black examinees. 

Type of Associative Relationship, items differentially more difficult 
for Black examinees tended to test "Case Relations," "Cause-Purpose," 
or "Space-Time" relationships. However, it would appear that such 
semantic classifications might not be particularly relevant to the 
study of DIF for Black examinees, especially if DIF is largely a 
function of non-analogical rea.soning by Black students. 
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These conclusions should be viewed as tentative. Due to the 
interdependence of several of the identified factors, and in some cases their 
limited occurrence, it is imperative that these factors be studied more 
systematically. A study in which factors such as position, subject content, 
level of abstractness, vertical relationships, homographs, vocabulary 
difficulty, and semantic relationships are controlled has been proposed. Once 
the identified factors are confirmed in a rigorously designed study, new test 
development guidelines can be developed. The current results, nevertheless, 
extend our understanding and identify factors that may cause differential item 
functioning in analogy items. 
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Table 1 

Summary of Sampling, Scaled Score Means, and Reliability Informati 





Sample Size 












Scaled Score 




Form 


Black 




Mean 


Reliability 


OF 




65,895^ 


431 


.921 


3H 


21,789^ 


278,099^ 


436 


.926 


4H 


23,115^ 


285,883^ 


440 


.922 


31 


8,757^ 


25,589^ 


399 


.921 


5E 


5,903^ 


35,218^ 


436 


.917 


Note: 


All five 


SAT forms are disclosed forms. 




^Representative 


Samples from Total 


Population 




Total 


Black and 


White Populations 


for whom English 


is the best la 
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Table 2 



Median Values of DIF Indices for Analogy Items 
by Verbal Section, Item Position, and Forms 



Forms 



Item 






3H 




4H 




5E 




i^vjsi t ion 


Uo ^^-^ 


DSTD2 


DSTD^ 


DSTD2 


DSTD^ 


DSTD^ 


DSTD^ 


DSTD^ 








Verbal 


1 (n-lO) 










J- J 


- . yj^- 


no 


-.07 


-.05 


-.07 


- .04 


-.03 


-.02 




- , uu 


. Ui 


.01 


.03 


- .01 


-.00 


.01 


.02 


All 


-.02 


-.01 


.00 


.02 


- 02 




nn 
- , uu 


. 01 








Verbal 


2 (n-.]0) 










1-5 


-.00 


-.00 


-.00 


-.00 


-.03 


- .03 


-.04 


- . 04 


6-10 


.01 


.01 


-.00 


-.00 


.02 


.02 


.02 


.02 


All 


.00 


.00 


-.00 


-.00 


.01 


.01 


.00 


.00 








Total Test (n-20) 










1-5 


-.02 


-.01 


-.05 


-.04 


-.03 


-.03 


-.03 


- .03 


6-10 


.00 


.01 


.01 


.02 


.02 


.02 


.01 


.02 


All 


-.01 


-.00 


-.00 


.00 


-.01 


-.00 


-.00 


.01 



Note. Position 1-5 refers to items 36-40 in Verbal 1 and items 16-20 in Verbal 2. 

Position 6-10 refers to items 41-45 in Verbal 1 and items 21-25 in Verbal 2. 

Note. DSTD^ is the standardized p-difference based on all Black and White students tO 
whom English was their best language who took the examinations. DSTD 
calculations exclude students who did not reach the item. ^ 
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Table 3 



Summary of Items Flagged as Differentially Difficult 
for Black Examinees by Form, Item Tjrpe, and DSTD 



DSTD^ DSTD^ 



- . 10<DSTD<« .05 <- . 10 - . 10<DSTD<- .05 <- . 10 
Item 

Type F (%) F (%) F (%) F (%) 



31 Artonyms (n-25) 

Analogy (n-20) 
Sentence Comp. (n-15) 
Reading Comp. (n-25) 

3H Antonym (n-25) 

Analogy (n-20) 
Sentence Comp. (n-15) 
Reading Comp. (n-25) 

4H Antonym (n-25) 

Analogy (n-20) 
Sentence Comp. (n-15) 
Reading Comp. (n-25) 

5E Antonym (n-25) 

Analogy (n-20) 
Sentence Comp. (n-15) 
Reading Comp. (n-25) 



2( 8) 


K 


4) 


2( 8) 


K 


4) 


K 5) 


K 


5) 


0( 01 


K 


5) 


0( 0) 


0( 


0) 


0( 0) 


0( 


0) 


1( 4) 


0( 


0) 


0( 0) 


0( 


0) 


1( 4) 


0( 


0) 


K 4) 


0( 


0) 


5(25) 


K 


5) 


4(20) 


K 


5) 


0( 0) 


0( 


0) 


0( 0) 


0( 


0) 


0( 0) 


0( 


0) 


0( 0) 


0( 


0) 


1( 4) 


K 


4) 


K 4) 


K 


4) 


4(20) 


0( 


0) 


2(10) 


0( 


0) 


0( 0) 


0( 


0) 


0( 0) 


0( 


0) 


1( 4) 


0( 


0) 


K 4) 


0( 


0) 


2( 8) 


0( 


0) 


2( 8) 


0( 


0) 


3(15) 


0( 


0) 


2(10) 


0( 


0) 


2(13) 


0( 


0) 


2(13) 


0( 


0) 


2( 8) 


0( 


0) 


2( 8) 


0( 


0) 



Note: DSTD^ is the standardized p-difference based on all Black and White 
students for whom English was their best language who took the 
examinations. DSTD2 calculations exclude students who did noc reach 
the item. 
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TaMe 4 

Median Values of DSTD^ for Analogy Items 
by Section and Fora for Subject Matter Classifications 



Form 

31 3H 4H 5E 



Section 


n 


Median 


n 


Median 


n 


Median 


n 


Media 








Aesthettc/Philosophical 








VI 


4 


-.01 


3 


.01 


2 


.01 


2 


.02 


V2 


2 


.01 


3 


-.00 


3 


.02 


3 


.02 


Total 


6 


.00 


6 


.01 


5 


.02 


5 


.02 








World of 


Practical 


Affairs 








VI 


2 


.01 


1 


.03 


3 


- .00 


3 


-.02 


V2 


3 


.01 


3 


.01 


2 


- .04 


2 


.02 


Total 


5 


.01 


4 


.02 


5 


- .00 


5 


-.01 










Science 










VI 


2 


-.03 


3 


-.05 


3 


-.04 


2 


-.03 


V2 


3 


-.02 


2 


-.08 


3 


.01 


3 


-.07 


Total 


5 


-.02 


5 


-.07 


6 


-.02 


«> 


-.03 








Human 


Relationships 








VI 


2 


.02 


3 


.02 


2 


.01 


3 


.03 


V2 


2 


.01 


2 


.02 


2 


-.00 


2 


.04 


Total 


4 


.01 


5 


.02 


4 


- .00 


5 


.03 
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Table 5 

Median Valuer dSID. for Analogy Items 
by Section, Form, and Word Abstractness 



Form 

3H 4H 5E 



Section 


n 


Median 






n 


Median 


n 


Median 










\Jl, l\gr 1, C i« C 










VI 


2 


- .02 


2 


• V/O 


0 




2 


- . 02 




A 


- . 00 


3 


- .06 


2 


-.02 


3 


- .OA 


Total 


6 


-.00 


5 


-.06 


5 


-.03 


5 


-.02 










Mixed 










VI 


4 


-.02 


4 


.02 


5 


-.00 




-.01 


V2 


3 


-.02 


3 


.01 


4 


.02 


4 


.05 


Total 


7 


-.02 


7 


.01 


9 


.01 


8 


.01 










Abstract 










VI 


4 


.01 


4 


.03 


2 


.01 


4 


.03 


V2 


3 


.02 


4 


.02 


4 


.01 


3 


.01 


Total 


7 


.01 


8 


.03 


6 


.01 


7 


.02 
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Table 6 

Median Values of DSTD2 for Analogy Items 
by Section, Form, and Relationship Between Stem and Key 



Form 

31 3H 4H 5E 



Section 


n 


Median 


n 


Median 


n 


Median 


n 


Median 










Independent 










VI 


6 


-.01 


8 


.02 


6 


• .01 


5 


.02 


V2 


7 


.01 


8 


.00 


7 


.02 


7 


.00 


Total 


13 


-.00 


16 


.02 


13 


-.00 


12 


.00 










Overlapping 










VI 


4 


-.00 


2 


-.02 


4 


-.02 


5 


.01 


V2 


3 


-.01 


2 


-.08 


3 


-.01 


3 


.36 


Total 


7 


-.01 


4 


-.06 


7 


-.01 


8 


.01 



40 
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Table 7 



Median Values of DSTD2 Analogy Items 
by Section, Form, and Vortical Relationships 



Form 

31 3H 4H 5E 



Section 


Code 


n 


Median 


n Median 


n 


Median 


n 


Median 






















VI 


0 


6 


- .01 


7 


.03 


c 
0 


- . 02 


6 


.02 




1 


4 


-.00 






4 


.00 


4 


- .00 


V2 


0 


5 


- 01 


7 


nn 


-7 

7 


.02 


8 


.00 




1 


5 


01 


3 


00 

• v/v/ 


Q 


- . 03 


2 


.02 


Total 


0 


11 


- .01 


14 


.01 


1 J 


- . 00 


14 


.01 




1 


9 


.01 


6 


.02 


7 


-.00 


6 


-.00 










Distractors 












VI 


0 


4 


.01 


4 


.03 


4 


-.00 


5 


.01 




1 


5 


-.01 


6 


.01 


4 


-.00 


1 


.03 




2 


1 


-.05 


0 




1 


-.04 


4 


-.03 




3 


0 




0 




1 


-.03 


0 


V2 


0 


5 


-.01 


2 


.05 


2 


.01 


4 


.04 




1 


5 


.01 


2 


.00 


4 


.02 


3 


- .04 




2 


0 




6 


04 


3 


.CI 


3 


- .01 




3 


0 




0 




1 


-.03 


0 


Total 


0 


9 


-.00 


6 


04 


6 


-.00 


9 


.02 




1 


10 


.00 


8 


00 


8 


.01 


4 


-.01 




2 


1 


-.05 


6 


04 


4 


-.02 


7 


- .02 




3 


0 




0 




2 


-.03 


0 
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Table 8 

Median Values of DSTD2 for Analogy Items 
by Section, Form, and Homographs in Stem and Key 



Form 



31 3H 4H 5E 
Hom. 



Section 


Code 


n 


Median 


n 


Median 


n 


Median 


n 


Median 










deem 












VI 


0 


6 


-.01 


10 


.02 


7 


-.02 


7 


.01 




1 


w 


-.00 


0 




3 


-.00 




01 


V2 


0 


9 


.01 


8 


-.00 


9 


.02 


9 


.01 




1 


1 


-.02 


2 


-.04 


1 


-.03 


1 


-.04 


Total 


0 


15 


-.00 


18 


.01 


16 


.00 


16 


.01 




1 


5 


-.01 


2 


-.04 


4 


-.02 


4 


-.02 










Key 












VI 


0 


5 


- .00 


9 


.02 


9 


-.00 


8 






1 


5 


-.01 


1 


-.03 


1 


-.06 


2 


-.00 


V2 


0 


10 


.00 


8 


.00 


10 


.01 


8 


-.00 




1 


0 




i. 


-.06 


0 




2 


.01 


Total 


0 


15 


-.00 


17 


.01 


19 


-.00 


16 


.01 




1 


5 


-.01 


3 


-.06 


1 


-.06 


4 


.01 
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Table 9 



Median Values of DSTD^ for Analogy Items 
by Section, Form, ana Total Homographs 



Form 

31 3H 4H 5E 







n 


iieaian 


n 


Median 


n 


Median 


n 


Median 


VI 


0 


4 


.01 


9 


.02 


4 


-.01 


4 


.00 




1 


1 


-.00 


1 


-.03 




-.01 


4 


.01 




2 


4 


-.00 


0 




3 


.01 


1 


- .02 




3 


1 


-.13 


0 




1 


-.06 


1 


.01 


V2 


0 


7 


-.00 


3 


.05 


8 


.02 


4 


,01 




1 


1 


.01 ■ 


4 


-.01 


2 


-.03 


5 


.01 




2 


1 


.03 


2 


-.o.s 


0 




1 


- 07 




3 


1 


-.02 


1 


-.06 


0 




0 


Total 


0 


11 


-.00 


12 


.03 


12 


.01 


8 


.01 




1 


2 


.01 


5 


-.02 


4 


-.03 


9 


.01 




2 


5 


.01 


2 


-.05 


3 


.01 


2 


- .05 




3 


2 


-.08 


1 


-.06 


1 


-.06 


1 


.01 



43 
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Table 10 

Median Values of DSTD^ for Analogy Items 
by Section, Form, and Semantic Relationship Classification 



Form 

31 3H 4H 5E 

tion n Median n Median n Median n Medi 



Class Inclusion & Part-Whole 



VI 


2 


-.01 


1 


-.08 


2 


.01 


2 


- .03 


V2 


3 


-.01 


2 


-.08 


0 




1 


.04 


Total 


5 


-.01 


3 


-.08 


2 


.01 


3 


- .02 








Similar 


fie Attribute 








VI 


2 


.01 


4 


-.01 


2 


.03 


1 


.01 


V2 


0 




3 


.01 


3 


.01 


5 


.02 


Total 


2 


.01 


7 


.01 


5 


.01 


6 


.02 








Contrast fie 


Non- At tribute 










0 




2 


.03 


1 


-.02 


2 


.03 


V2 


4 


.01 


2 


.01 


1 


.02 


0 




Total 


4 


.01 


4 


.03 


2 


- .00 


2 


.03 






Gas Relations, Cause-Purpose fie Space-Time 






VI 


6 


-.00 


2 


.03 


5 


- .04 


3 


.01 


V2 


2 


-.01 


2 


.03 


5 


.02 


4 


-.06 


Total 


8 


-.01 


4 


.01 


10 


-.02 


7 


- .04 








Representation 










VI 


0 




1 


.06 


0 




2 


.02 


V2 


1 


-.00 


1 


.06 


1 


-.03 


0 




Total 


1 


-.00 


2 


.00 


1 


-.03 


2 


.02 
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TabU 11 

SAT Analogy Itmt from Form 31 
with 8i&h Diff«r«ntiil Ztta Functioning 



Itttm 
No. 



Iti 



DSTD« 



TD 

Class. 



Characteristics 



Vartical 
Ral. 



Honx9 graph 



Semantic 
Rel 



37 WHITTUiSTICK: : 

.02 (A) lick:h«nd 

(B) shatter: glass 

hafliD«r:nail 
((D| chisalrstona 
nuzzlamosa 
.04 Cknittad 




-.1316 



.49 



Aasthatic 
Mixad 

Indapandtnt 



Kay 



Stem 
Kay 

A 

C 




18 DASHIKL GAKMENT : : 

KA)) apoon:attnsil 
hat: coat 
-.01 (C) cotton raisnnar 

.00 (D) footrahoa 
-.02 (E) platartabla 
-.12 Otoittad 

41 TIDINGS:MF3SE1IGER: : 

clua:datactiva 
\ gossip; taUt«la 
vardict:ccinvict 
(D) ina\)g\iration:votar 
.00 (E) aaqpoaurais'/ 
-.01 Cknittad 



.2006 



.70 




.0563 



.38 



Practical 
Affairs 
Cone rata 
Indapandant 



Buman 
Miz^d 

Overlapping 



Othar ItacQs of Zntarast 



39 R£FIM£:FETROL£UM:: 

.03 consuBMifual 
-.02 ttB)) s»«lt:ora 

.00 CC; proapact:\iranium 
-.03 (D) bland: aUoy 

.01 (E) import rxtibbar 

.02 Otoittad 



.0199 



.40 



Scianca 
Mixad 

Overlapping 



Key 
A 



42 COHPLEXiBUILDIRG:: 

-.01 (A) tapeatry: fabric 
(B) apple: tree 

c 1 a s s r ooo : c aiDpu a 
faderetion:atate 
highway: truck 
.01 Ot^tted 




.0138 



.26 



Aesthetic 
Mixed 

Independent 



Stem 
Key 



Pg ia tha actual proportion correct for the Black subgroup. 

Vaiuss prsceding optiona represent DSTD. bssed on distrsctor analysis. The numbers under "Semantic 
Rel.** represent the following clessificationa: 1 - Claas inclusion and Pe-t-whole, 2 - Similar and 
Attribute. 3 - Contrast and Hon-ettribute, 4 - Caae relation, Cause-purpose, and Space-time, and 
5 - Reprasentation. 



46 



40 



Ttbl« 12 

SAT Analogy Items from Foia 3H 
with Bish Diffor^ntial ItcQ Functioning 



ItMQ 

No. 



16 



It«o 




tkin: fruit 
d«w:srasa 
a««d:flovrtf 
p«ak:hiU 
.01 (E) wak«:boat 
.00 Qaittttd 



Characttrifttics 



DSTD„ 



TD 

Class. 



Vartical 

Rol. 



Homograph 



Semantic 
Re I 



.1009 



.74 



Scitnca 

Concrata 

Ovarlapping 



Stem 
£ 



37 CUMULUS: CLOUD:: 

.01 (A) Iaka:ocaas 
.01 (B) carDivora:maat 

SlkiCiar:blizz«rd 
•vargraan:traa 
•vding: daylight 
.02 Okaittad 



.0801 



.48 



Sciancn 
Hixad 

Indapandant 



21 GULLY: EROSION:: 

drot2ght:pracipitation 
I minaraxcavation 
clot : diaparaion 
-.01 (D) foraat: cultivation 
.00 (E) watar: inundation 
.07 Okaittad 




.0653 



.33 



Scianca 
Miaad 

Indapandant 



A 

£ 



K/>y 



36 AUTOBIOGRAm:AUTB0R:: 

.02 (A) autograph:signatura 
.01 (B) aalf-aufficiancy: 
proviaior 
automation : wo rkar 
salf-portrait : artiat 
autopsy: doctor 
.00 OoBittad 




.0624 



.83 



Aaathatic 

Concrata 

Ovarlapping 



Kay 
A 



17 £XCERFT:BOOIC:: 

.01 (A) typarpaga 

acript:play 
aolo:routina 
clip:filis 
dracn«:nuaical 
.01 Ctoittad 




.0563 



.60 



Afisthatic 

Concrata 

Ovarlapping 



Kay 
A 
B 



Key 
A 
B 



20 



39 



BLUEPRIHT:BUILDIWO:: .0612 .6j 

-.02 (A) racaipt:nwnay 
-.02 (B) tymphony: cone art 
-.02 (C) fflaprautocDobila 

briafcaaa:lawyar 
aganda:maatins 
ttad 

^:RECLUSE:: .0511 .38 

j^A% attantion:axhibitionist 

courtasy : braggart 
(C) povarty: donor 
.00 (D) abuaa:official 
.00 (E) paraacution:diractor 
-.04 Okaittad 




Practical 
Affairs 
Mizad 

Indapandant 



Human Ral. 
Hizad 

Indapandant 



is tha actual proportion corract for tha Black subgroup. 

^aluas pracading optiona raprasant DSTD^ basad on dlatractor analysis. Tha numbers under "Semantic 
Ral." raprasant tha following classifications: 1 - Class inclusion and Part-whole, 2 - Similar and 



Attribute. 3 - Contrast and Kon-at tribute. 4 - Case relation, Cause-purpose. 
5 - Representation. 



and Space -time, and 



ERIC 



4b 
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Tablt 13 



Item 
No. 



17 



AO 



42 



37 



30 



SAT Anclogr Ittms from Form 4B 
with High Dlffarantlal Item Functioning 



Charactaz .sties 



Itatr 



DSTD« 



TD Vertical Semantic 

Class. Rel. Homograph Rel. 




-.09 
.01 
.02 
.03 
.02 



'M goU: individuals 
m) football: spactators 

(C) badaiinton:rackats 

(D) coach:pIayara 
(S) baaaball:baaaa 



-.0863 



.67 




.01 Qnittad 

£CBO:SOUHD:: 
.00 (A) outUnarinaga 

aoqplifiarrapaakor 
iCi^ raflaction: light 
daflaction:bIow 
(E) raaiatorralactricity 
.01 Ottittad 

SYCOFHART:FLAITZRY: : 
.00 (A) iapoatar:dafaranca 
<B) anbazxIar:inaoIaiica 
bandit: hypocrisy 
I awindIar:frfuduXanca 
advocata:dafamation 
-.09 Qpaittad 



.0592 



.48 



Practical 

Affaira 
Mixad 

Ovarlapping 



Scianca 
Mizad 

Ovarlapping 



Kay 

B 



Key 
B 
D 



.0550 




.23 Busan Ral. 
Miztd 

Indapandant 



Othar Items of Intarast 




GEYSER: STEAM:: 

fountain: com 
volcano: lava 
glaciar:icabarg 
ava lanchaitraas 
(E> oxidalida:rocya 
.01 Qnittad 

:FROSE: : 
[ stanza :poatry 
tanor:hanQony 
rafrain:chorua 
.00 (D) aignatura:Iattar 
.02 (E> adition:book 
-.03 Qaittad 



-.0425 



.65 




.0259 



.38 



Scianca 

Concrata 

Indapandant 



Aaathatic 

Abstract 

Ovarlapping 



Key 



43 ABYSSiniTCH: : 

.00 ^Ay conflagration :campfira 
.02 (5) vaIocity:accaIaration 
.01 (C) unibralla:rain 
.01 (D) aquara:ractangla 
.01 (E) baaaoant:housa 
-.05 Qsaittad 



-.0036 



.12 



Scianca 

Concrata 
Indaperdant 



Stem 



23 PURITANICAL : FRIVOLITY : : 

.00 (A> sacrativa: ascendancy 
.01 (B> neurotic: phobia 
.01 (C) intrepid: courage 
.02 raligioua : doctrine 
.02 ft£^ lesy:ezertion 
-.06 CSitted 



.0158 



.21 



Aesthetic 

Abstrect 

Independent 



Pg ii the ectuel proportion correct for the Black eubgroup. 



Values preceding options repreaant DSTD^ based on distractor analysis. The numbers under "Seamtic 
Rel.- represent the following classifications: 1 - Class inclusion and Part-whole, 2 - Similar and 
Attribute, 3 - Contrast and Hon- attribute, 4 - Case ralation, Causa-purpoa-j, und Space-time, and 
5 - Rspraeentetion. 



ERIC 
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Tabl9 14 

SAT Analogy Itoma from Form 5E 
with High Differential Item Functioning 



Character istics 



Item 
Ho. 



X7 



19 



21 



20 



41 



Item 



DSTD^ 
-.0825 



B 



CANOElBAPIDS:: 
'.06 UAj plane:tuxbultnce 

.00 uf) truckrgarage 

• OS (C) oaz:rovfboat 

.01 (D) factory: automation 

.01 (E) poud:etreaio 

.02 Onitted 

ACR£:LAin): : -.0746 

.05 (A) distfcce: apace 

.01 ap«ad:nov«atnt 
-.07 ^Ci gaUcn:liquid 

.01 CtO degree: thermometer 

.00 (2) 7ear:birtbdaT 

.01 QoBitted 

COMPATRIOTS tCOUHTRY: : .0640 

.00 trans i ants :hoffia 

.06 KB) kinsfolk: family 
-.08 (C5 CQaspatitore:team 

.00 (D) parfomars: audience 
"-.Ol (S) figureheade:govemaent 

.01 Qoaitted 

CONVENE: ASSEMBLY:: .0601 
.01 
.00 
.00 
-.02 
.06 
-.04 



.46 



.32 



(A) borrow: library 

(B) ra):rove:defianee 

(C) contrast: shadow 
pX) implicate: court 
y(E^ compile: collection 
Omittad 



.45 



APOLOGY:RUEFUL:: 

-.02 (A) eonfeshlon: inquisitive 

-.04 (B) request:grateful 

.01 CC) recoenendation: censorious 

.06 uD^ boast: proud 

.01 cS5 taunt: timid 
-.02 emitted 



0587 



.26 



TD 

Class. 



Vertic^- 
Rel. 



BozDOgrrph 



Semantic 
Rel. 



.66 Science 
Concrete 
Independent 



Science 
Mixed 

Independent 



Buman Rel. 
Mixed 

Overlapping 



Practical 
Affairs 
Mixed 

Overlapping 



Bumen Rel. 

Abstract 

Independent 



Key 



Other Items of Interest 



38 


ALUMINUM: METAL:: 


-.0338 


.61 Science 


A 


0 1 




-.01 (A) elloy:element 




Mixei 


B 




.04 (B) eteel:tin 




Independent 








.00 (C> hydrogen :riter 












-.03 Kpj ozygen:gas 












.00 diamond: ring 












.00 Omitted 










39 


R£fi£ARaM,:PLAY:: 


.0123 


.59 Aesthetic 


C 


Si.em 4 




.01 O) draft:eesay 




Mixed 


D 


Key 




.01 (H) manual:proceBs 




Overlapping 




B 




.04 (C) applause: performance 












-.06 (D) recital:concert 












.01 (E) joumal:news 












.00 Omitted 











Pg is the actual proportion correct for the Black subgroup. 

^Talues preceding options represent DSTD^ based on distractor analysis. The numbers under -Semantic 
Re.i..'* represent the following classifications: 1 - Class inclusion and Part-whole. 2 - Similar and 
Attribute, 3 - Contraet and Non- attribute, 4 - Case relation. Cause-purpose, and Space-time, and 
5 - Repreeentation. 
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FIGURE 1 - FORM 31 / V1 ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 2^ - FORM 31 / V2 ANALOGY ITEMS 
STANDARDIZED DIFFFRENTIAL ITEM FUNCTION VALUES 
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DSTD value for Item 18 on V2 is .20 and is out of 
bound from the values represented on Figure 2. 



FIGURE 3 - FORM 3H / VI ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 4 - FORM 3H / V2 ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 5 - FORM 4H / VI ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 6 - FORM 4H / V2 ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 7 - FORM 5E / VI ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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FIGURE 8 - FORM 5E / V2 ANALOGY ITEMS 
STANDARDIZED DIFFERENTIAL ITEM FUNCTION VALUES 
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